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(54) Sampling rate conversion using digital differential analyzers 

(57) Magnification/reduction of a video image is achieved by a single FIR filter 19 under the control of a 
Digital Differential Analyzer (DDA) 21 as would be used to simulate a perfectly straight line on a 
two-dimensional raster. The single FIR filter 19 combines the processes of interpolation, filter, and decimation. 
The DDA 21 is programmed with the desired magnification/reduction ratio and provides signals that control 
shifting of input samples into the FIR filter 19 and selection of FIR coefficients for the FIR filter 19. 
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At least one drawing originally filed was informal and the print reproduced here is taken from a later filed formal copy. 
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SAMPLING RATE CONVERSION 
USING DIGITAL DIFFERENTIAL ANALYZERS 



The present invention relates generally to a system 

15 for sampling rate conversion and particularly to a system that 
resamples by way of interpolation, filtering, and decimation. 

During display of a video image sequence, it is 
often desirable to magnify or reduce an original video frame 
size or viewing area size on screen. For example, in 

20 multimedia systems it is desirable to allow users to change 
the size of multiple video images from time to time. 
Magnification and reduction capabilities also find application 
in picture- in-picture features in consumer televisions. 

Often, original video images to be reduced or 

25 enlarged are available in digital form, having been received 
from television or direct satellite broadcast, decoded from 
MPEG (Moving Picture Expert Group) and JPEG (Joint 
Photographic Expert Group) standards coded bitstream, or 
downloaded from CD ROMs. One way to achieve magnification or 

3 0 reduction of digitized video images is to use the techniques 
of interpolation, linear filtering and decimation of image. 

A video system capable of displaying digital video 
images typically displays a fixed number of pixels per scan 
line and a fixed number of scan lines per image. The spacing 

35 between pixels on a scan line is also fixed. To magnify (or 
reduce) an image for display is equivalent to increasing (or 
decreasing) the number of pixels or samples that represent the 
image so that an increased (or decreased) display area is 
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obtained on the video monitor. Thus magnification or 
reduction can be implemented as a sampling rate conversion 
process applied to each video scan line. A general 
mathematical scheme of sampling rate conversion is disclosed 
5 in Ronald E. Crochiere and Lawrence R. Rabiner, "Multirate 

Digital Signal Processing, n Prentice-Hall, 1983, the contents 
of which are herein expressly incorporated by reference for 
all purposes. 

To realize such a sampling rate conversion scheme, 
10 the necessary interpolation and decimation factors must first 
be determined. For an input signal x(n) with sampling period 
T^ (or sampling frequency F in ) and a resampled output signal 
y(n) with sampling period T out (or sampling frequency F out ) , 
the following ratio is formulated, 

T in 0 F out m L 

T out F in M . . . (1) 

15 where L and M are integers and are referred to as the 

interpolation factor and decimation factor, respectively. For 
L > M, the output signal y(n) achieves an increased sampling 
rate and hence an increased number of samples or pixels per 

20 scan line. The visible effect is a magnified video image when 
displayed because more pixels occupy more physical space on 
screen. For L < M, the opposite effect is obtained. 

To implement magnification/reduction in this way, 
three functional blocks are typically used: an interpolator, a 

25 low-pass filter, and finally a decimator. The interpolator 
first places L-l zero-valued samples between successive 
samples in x(n) . This operation increases the sampling rate 
of the signal x(n) by a factor of L and creates L-l folds of 
spectral images in the frequency domain of the interpolated 

30 signal. The low-pass filter is then employed to filter out 
these spectral images while retaining the component at the 
baseband. Finally, the filtered signal is decimated with a 
factor of M, that is, the decimator outputs every M-th sample 
to form the output signal y(m) . Mathematically, the sampling 
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rate conversion process is expressed as 

GO 

y(m) * E h(Mm - nL) x(n) . . . (2) 

where {h(n)> represents the low-pass filter. 

However, a magnification/reduction system that 
5 incorporates a distinct interpolator , low-pass filter, and 
decimator is complex and costly to implement, requiring 
extensive VLSI surface area. A P-tap FIR implementation of 
the low-pass filter, necessarily operates at L times the input 
sample rate and thus requires L*P operations per input sample. 
10 What is needed is a more efficient magnification/ reduction 
scheme suitable for VLSI implementation. 



SUMMARY OF THE INVENTION 
In accordance with the invention, magnification/ 

15 reduction is achieved by a single FIR filter under the control 
of a Digital Differential Analyzer (DDA) as would be used to 
simulate a perfectly straight slope line on a two-dimensional 
raster. The single FIR filter combines the processes of 
interpolation, filtering, and decimation. The DDA is 

20 programmed with the desired magnification/reduction ratio and 
provides signals that control shifting of input samples into 
the FIR filter and selection of FIR coefficients for the FIR 
filter. In one embodiment, a prefilter and decimator are 
provided for optionally preprocessing the input so that an 

25 overall reduction in computation is provided by magnification 
within the FIR filter itself. 

In one embodiment suitable for use with color 
digital video systems, a first FIR filter controlled by a 
first DDA applies magnification/reduction to a luminance 

30 signal, Y, and a second FIR controlled by a second DDA applies 
magnification/ reduction to an interleaved combination of two 
chrominance signals, C b and C r . The two chrominance signals 
are processed separately within the second FIR. 

In accordance with one aspect of the invention, a 

35 DDA adapted for use in magnification/ reduction includes a 
ratio register, an adder, and a status register. A 
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magnification reduction ratio H/L is stored in the ratio 
register with L being restricted to being a power of two. 
This ratio is summed by the adder into the status register 
after every calculation of an output sample by the FIR filter. 
5 The status register thus tracks the output sample position as 
compared to the input sample position. The necessary width of 
these registers depends on the expected cumulative error 
across a single scan line, since the DOA is typically reset 
upon completion of a particular scan line. 
10 In one particular embodiment, the status register 

has twelve bits [11] through [0] with [11] being the most 
significant bit and [0] being the least significant bit with a 
decimal point implied between bits [10] and [9]- For an 
interpolation factor, L »4, bits [9-8] are used to select from 
15 among four sets of FIR coefficients for the FIR filter for 

each calculation of an output sample. For other values of L 
which are powers of two, log 2 L bits beginning with bit [9] 
would be used for this purpose. For magnification, a toggling 
of bit [10] is the signal to shift a new sample or pixel into 
20 the FIR. For reduction, bits [11-10] indicate how many 

samples or pixels are to be shifted into the FIR after the 
calculation of each output sample. This control of the input 
shifting achieves the necessary interpolation by L. 
Decimation by M is achieved since the output sample position 
25 is incremented by the magnification/reduction ratio. 

The invention will be better understood by reference 
to the following detailed description in connection with the 
accompanying drawings. 

30 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of the sampling rate 
conversion system according to one embodiment of the present 
invention. 

Fig. 2 is a detailed diagram of a DDA controller 
35 responsible for controlling other functional blocks in the 

sampling rate conversion system of Fig. 1 in accordance with 
one embodiment of the present invention. 
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Fig. 3 is a detailed diagram of a luminance filter 
for resampling a luminance signal in accordance with one 
embodiment of the present invention* 

Fig. 4 is a detailed diagram of a chrominance filter 
for resampling chrominance signals in accordance with one 
embodiment of the present invention* 

Fig. 5 is a detailed diagram of a status register 
within the DDA controller of Fig* 2 indicating the 
significance of the various bits* 

DESCRIPTION OF THE SPECIFIC EMBODIMENTS 
The preferred embodiment of the sampling rate 
conversion system of the present invention is directed toward 
processing of video image signals in order to achieve an image 
magnification or reduction effect* Sampling rate conversion 
could be achieved in other contexts as well in accordance with 
the present invention* 

Fig. 1 is a block diagram of a sampling rate 
conversion system 1 according to one embodiment of the present 
invention* There are two inputs 10 and 11 to the system, one 
for a luminance signal component Y (or Y pixel) and one for 
two chrominance signal components Cb and Cr (or simply Cb 
pixel and Cr pixel) * At the chrominance input 11, the Cb and 
Cr pixels are interleaved and together have a sampling rate 
the same as the Y pixel at the luminance input 10. 

The luminance signal and interleaved chrominance 
signal are resampled separately. Each signal is fed through a 
buffer 12 , a switch 13 , then depending on the setting of 
switch 13 through a prefilter 16 and a decimator-by-K 17 or 
alternatively directly to luminance filter 19 or chrominance 
filter 20. The FIR coefficients of luminance filter 19 and 
chrominance filter 20 are stored in FIR coefficient storage 
18* The luminance signal is resampled within luminance filter 
19 under the control of a luminance DDA (Digital Differential 
Analyzer) 21. The chrominance signal is resampled within 
chrominance filter 20 under the control of a chrominance 
DDA 21* 




6 

Buffers 12 nay be implemented using either RAMs 
(random-access-memory) or FIFO (first-in-first-out) memories. 
The switches 13 enable activation of a preprocessing stage 
that includes prefilter 16 and decimator-by-K 17. Prefilter 
5 16 is an FIR low-pass filter whose coefficients are selected 
in accordance with factor K to eliminate spectral aliasing at 
the output of decimator-by-K 17 by reducing the bandwidth of 
the input signal by a factor of K. By including these blocks 
in the signal path, image reduction can be achieved even 
10 though luminance filter 19 and chrominance filter 20 operate 
to perform image magnification. 

Luminance filter 19 and chrominance filter 20 are 
responsible for the operations of interpolation , FIR 
filtering, and decimation inherent in resampling. Luminance 
15 filter 19 operates on the Y signal and chrominance filter 20 
operates on both the Cb and Cr signals. Since each of the Cb 
and Cr signals have an effective sample rate that is half that 
of the Y signal, chrominance filter 20, clocked at the same 
speed as luminance filter 19, alternately processes the Cb and 
20 CR sample streams in a time-multiplexed fashion. 

The FIR coefficients used by the luminance and 
chrominance filters 19 and 20 are stored in FIR coefficient 
storage device 18. Storage device 18 can be implemented using 
RAM or similar electronic devices. As will be explained 
25 below, the FIR coefficients are grouped into sets within 

storage device 18 with each set being independently selectable 
by the luminance DDA and chrominance DDA controllers 21. The 
resampled luminance and chrominance signals exit from the 
output of filters 19 and 20 respectively. 
30 The operation of DDA controllers 21 is critical to 

achieving the resampling operation within luminance filter 19 
and chrominance filter 20. Fig. 2 is a detailed diagram of 
one of DDA controllers 21. An input 30 is used to program a 
desired magnification/reduction ratio. This ratio is stored 
35 in a ratio register 31. in the preferred embodiment, the 

ratio register is eleven bits wide, [10..0], where bit [10] 
denotes the MSB and bit [0] denotes the LSB with a decimal 
point being placed between bits [10] and [9]. 
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r. The magnification/reduction ratio can be expressed 

as: 

Ratio - « H 

Tm * • • .(3) 

This ratio is computed and rounded off to a 10-bit binary 
5 fraction plus 1-bit integer number prior to storage in ratio 
register 31. The following cases are possible: 

Ratio < 1: sampling rate increase or image magnification 
Ratio = 1: no change to sampling rate or image copy 
Ratio > 1: sampling rate decrease or image reduction 
10 For the preferred embodiment, Ratio < 2 is constrained to be 
less than 2 due to the configuration of ratio register 31. 

The output of ratio register 31 represents a first 
input to a 12-bit adder 32. The output of 12-bit adder 32 is 
stored in a 12-bit status register 33. The output of status 
15 register 33 is an input to a decode logic unit 35 for control 
signal generation and at the same time it is connected to the 
other input of the 12-bit adder 32 through a feedback path 34. 
Decode logic unit 35 decodes the bit information from the 
status register 33 to generate two signals. One signal 
20 selects a particular group of FIR coefficients for retrieval 
to the filter controlled by the DDA. The other signal 
controls shifting of pixels into the filter. 

Both the 12 -bit adder 32 and 12 -bit status register 
33 have bit fields labeled [11..0] with bits being aligned 
25 for "add" operation by 12-bit adder 32. A decimal point is 
implied between bit [10) and bit [9] for adder 32 and status 
register 33. 

The width of registers 31 and 33 and adder 32 is 
chosen so tnat rounding error accumulated in status register 

30 33 does not effect resampling operation. In the preferred 
embodiment, status register 33 is cleared after every scan 
line, thus limiting accumulation of error. With a maximum of 
720 pixels per input scan line and a maximum of 1,024 pixels 
per output scan line, the 11 bit width of ratio register 31 

35 and 12 bit width of status register 33, which give a maximum 
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accumulation error of (1,024 * 2" 11 ) * T out , have been found to 
be sufficient. 

Fig. 3 is a detailed diagram of luminance filter 19 
for resampling a luminance signal in accordance with one 
embodiment of the present invention. Eight FIR coefficients 
are loaded through an input 40 to 4 pairs of coefficient 
registers 41, labeled CO through C7. The particular group of 
FIR coefficients loaded will depend on the output of DDA 
controller 21. The luminance samples or pixels from buffer 12 
are loaded through an input 43 to eight shift registers 44, 
labeled Y 0 through Y 7 . The eight shift registers 44 are 
connected in a cascaded fashion, that is, the output of Y 7 is 
connected to the input of Y 6 and so on. Each shift register 
preferably comprises an 8-bit flip-flop. The outputs of each 
pair of registers 41 and the corresponding two shift registers 
are connected to the inputs of a multiplier 42. Thus, there 
are four multipliers 42. The outputs of the four multipliers 
are fed to a 5-input adder 45. The fifth input of the 5-input 
adder is fed from its own output 46. Output of 5-input adder 
45 also serves as the output for the resampled luminance 
signal. The luminance filter completes a sum of eight 
multiply-and-accumulates, e.g. an 8-point convolution 

7 

i ■ 0 . . . (4) 

and send the result to output 46 at a throughput of one sample 
every two cycles. The loading of pixels into shift register 
44 via input 43 and selection of coefficients for loading into 
registers 41 via input 4 0 is controlled by luminance DDA 
controller 21. 

The internal operation of chrominance filter 20 is 
similar to that of luminance filter 19 except it computes 
separate 8-point convolutions for chrominance signals Cb and 
Cr. Fig. 4 is a detailed diagram of chrominance filter 20 for 
resampling chrominance signals in accordance with one 
embodiment of the present invention. Four pairs of 
coefficient registers 51, labeled B0 through B7, are loaded 
with coefficients from FIR coefficient storage 18. Unlike 



luminance filter 19, chrominance filter 20 contains an 
additional set of 8 shift registers to handle Cb and Cr 
separately. Chrominance Cb pixels are loaded via an input 53 
to a shift register set 54, labeled U 0 through U 7 and Cr 
pixels are loaded from input 55 into a shift register set 56, 
labeled V 0 through V 7 . Four multipliers 52 and a 5 -input 
adder 57 are shared for computing the output Cb and Cr 
signals, that is, the two 8 -point convolutions 

i 5 o 0l * Bl ' • • • m 

for chrominance Cb signal and 

7 



for chrominance Cr signal. As with luminance filter 19, a 
throughput of two cycles is maintained for performing both 
convolutions. The resulting Cb and Cr output samples are 
computed alternately and interleaved to an output 58. 

In operation, DDA controllers 21 control selection 
of FIR coefficients and input of pixels for luminance filter 
19 and chrominance filter 20. If the distance between 
successive input samples or pixels on the scan line is 
understood to be unity, the contents of status register 33 can 
be understood to represent a position of the current output 
sample. The value of the bits to the right of the decimal 
point indicate the distance between the current output pixel 
and the input pixel immediately to the left. For the first 
output pixel, status register 33 contains zero, indicating the 
first input pixel is copied to the first output pixel. For 
each succeeding output pixel, status register 33 is 
incremented once with the contents of ratio register 31. For 
the case of image magnification, the contents of ratio 
register 31 are less than one. For the case of image 
reduction, the contents of ratio register 31 are greater than 
one but less than two. 

Thus, the timing of each DDA controller is 
synchronized to the generation of new output pixels. After a 
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new output pixel Is generated, the number of pixels, if any to 
be shifted into the filter must be determined. For the case 
of image magnification, a toggling of the LSB to the left of 
the decimal point indicates that a single pixel is to be 
shifted in. In the preferred embodiment, this refers to bit 
[10]. 

For the case of image reduction, the bits to the 
left of the decimal point indicate the number of pixels to be 
shifted in to the filter after calculation of an output pixel. 
These bits to the left of the decimal, point are reset before 
every update to the status register. In the preferred 
embodiment, these are bits [11. .10). 

The proper FIR coefficients to be applied will 
depend on the alignment of the output pixel to be calculated 
relative to the input pixels. Lowpass filtering is implicitly 
applied to the interpolated input stream, that is the input 
pixels with L-l zeroes interspersed between each input pixel 
to eliminate spectral folding. However, coefficients that 
currently align with zeroes in this interpolated input stream 
are not needed and are deleted from the coefficient set for 
computational efficiency. The coefficients that are needed 
thus will vary depending on the alignment of the output sample 
to be calculated in relation to this interpolated input 
stream. Since there are L possible alignments, L coefficient 
sets are , required . 

The needed coefficient set is identified by the 
log 2 L bits to the right of the decimal point in the status 
register. The ODA controller addresses FIR coefficient 
storage 18 to provide these coefficients to the appropriate 
filter prior to the calculation of each output sample. In the 
preferred embodiment, L=4 and bits [9 ..8] identify the 
coefficient set to be selected. Fig. 5 is a detailed diagram 
of status register 33 indicating the significance of the 
various bits. The operation of the luminance DDA controller 
is similar to that of the chrominance DDA controller. The 
chrominance DDA controller runs at half speed since the input 
sample rates for the Cb and Cr signals are half that for the Y 
signal. 
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In an alternate mode that can be selected by use of 
switch 13 , image reduction is processed by the luminance and 
chrominance filters 19 and 20 and their associated DDA 
controllers 21 as image magnification. In this alternate 
mode, prefilter 16 and decimator-by-K 17 are included in the 
input path for the luminance and chrominance signals. 
Prefilter 16 is preferably a 3-tap FIR filter and decimator 17 
preferably has K = 2 sending every other pixel to the 
luminance and chrominance filters 19 and 20. Thus, the 
sampling rate into the luminance and chrominance filters is 
reduced by a factor of 2 from the inputs 10 and 11. As the 
result, the overall reduction ratio becomes 

Ratio = T ° ut = _2L 

2 * T in 2 * L . . .(7) 

Since the input sampling rate is thus limited to be no greater 
than twice the output sampling rate. Ratio for this mode of 
operation is less than unity. When this mode is used, the 
luminance and chrominance filters always perform sampling rate 
upconversion whether image magnification or reduction is 
required. The advantage of this is that the filters only need 
to operate in magnification mode, eliminating the need for 
shifting in two input pixels for one output pixel during image 
reduction. Prefilter 17 may be modified to have more taps in 
order to minimize spectral aliasing. 

Thus, the present invention permits resampling 
within a single FIR filter without the need for a separate 
interpolator and decimator. Thus, needed VLSI surface area is 
minimized while maintaining computational efficiency. 

While the above is a complete description of the 
preferred embodiments of the invention, various alternatives, 
modifications, and equivalents may be used. It should be 
evident that the present invention is equally applicable by 
making appropriate modifications to the embodiments described 
above. Therefore, the above description should not be taken 
as limiting the scope of the invention which is defined by the 
metes and bounds of the appended claims. 



CLAIMS 

1. A sampling rate conversion system comprising: 

an FIR filter that receives a discrete signal to be 
resampled via a first input and FIR coefficient data via a 
second input and provides a filtered output; 

an electronic memory device coupled to said FIR 
filter that stores said FIR coefficient data; and 

a DOA controller coupled to said FIR filter and said 
electronic memory device that receives a desired 
magnification/reduction ratio, M/L, wherein L and M are 
integers, and that coordinates shifting of said discrete 
signal into said FIR filter with selection of coefficients 
from said electronic memory device so that said filter output 
achieves said desired magnification/reduction ratio* 

2. The sampling rate conversion system of claim 1 
wherein said DDA controller comprises: 

a ratio register that stores said 
magnification/ reduction ratio and provides said ratio as an 
output; 

an adder that adds a first adder input to a second 
adder input to provide an adder output, wherein said ^ first 
adder input is coupled to said output of said ratio register; 

a status register that receives said adder output as 
an input and provides said second adder input as an output, 
wherein said ratio register is summed into said status 
register by said adder after every calculation by said FIR 
filter of a sample of said filtered output; and 

a decoder circuit that receives said output of said 
status register as an input and provides 1) an input shift 
control signal to said FIR filter to control shifting of input 
samples into said FIR filter,- and 2) a coefficient selection 
signal to said electronic memory device to select a group of 
FIR coefficients to be loaded into said FIR filter. 

3. The sampling rate conversion system of claim 2 
wherein a current value of said status register represents an 
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alignment between said a current output pixel and a nearest 

4 input pixel to the left. 

1 4. The sampling rate conversion system of claim 3 

2 wherein said coefficient selection signal selects from among L 

3 sets of coefficients stored in said electronic memory device 

4 depending on a value of log 2 L preselected bits to the right of 

5 an implied decimal point in said status register. 

1 5. The sampling rate conversion system of claim 3 

2 wherein for a sampling rate increase said input shift control 

3 signal operates to shift a pixel into said FIR filter when a 

4 least significant bit to the left of an implied decimal point 

5 of said status register toggles. 

! 6. The sampling rate conversion system of claim 3 

2 wherein for a sampling rate decrease said input shift control 

3 signal operates to shift as many pixels as are indicated by 

4 bits to the left of an implied decimal point of said status 

5 register. 

1 7. The sampling rate conversion system of claim 4 

2 wherein said status register has 12 bits, [0]-[ll] with [0] 

3 being the least significant bit, [11] being the most 

4 significant bit with an implied decimal point between bits 

5 [10] and [9], said predetermined bits consisting of log 2 L 

6 contiguous bits with [9] being the highest of said 

7 predetermined bits. 

1 8. The sampling rate conversion system of claim 1 

2 further comprising: 

3 a decimator having an output coupled to said input 

4 of said FIR filter; and 

5 a prefilter having an output coupled to an input of 

6 said decimator. 
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1 9. The sampling rate conversion system of claim 1 

*±r wherein said discrete signal comprises a luminance signal of a 

3 digital video system. 

1 10. The sampling rate conversion system of claim 1 

2 wherein said discrete signal comprises interleaved first and 

3 second chrominance signals of a digital video system and said 

4 FIR filter processes said first and second chrominance signals 

5 separately . 

1 11. A sampling rate conversion systems as 

2 claimed in claim 1 substantially as described herein with 

3 references to any one of the Figures of the accompanying 
* drawings . 
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